Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

0 rows replicated for 'mailings' table #17

Open
eestack opened this issue Feb 14, 2022 · 1 comment
Open

0 rows replicated for 'mailings' table #17

eestack opened this issue Feb 14, 2022 · 1 comment

Comments

@eestack
Copy link

eestack commented Feb 14, 2022

0 rows are being replicated for my 'mailings' table, even though there are certainly rows there. Log is below- issue in bold. Any help is appreciated!

2022-02-14 11:30:16,472Z main - INFO Running tap-outreach version 0.7.0 and target-stitch version 3.2.0
2022-02-14 11:30:17,638Z main - INFO [smart-services] building smart service producer: topic( com.stitchdata.extractionJobStarted ), use_ssl( true )
2022-02-14 11:30:17,641Z main - INFO [smart-services] building smart service producer: topic( com.stitchdata.extractionJobFinished ), use_ssl( true )
2022-02-14 11:30:17,642Z main - INFO [smart-services] building smart service producer: topic( com.stitchdata.streamRecordCount ), use_ssl( true )
2022-02-14 11:30:18,286Z main - INFO [smart-services] event successfully sent to kafka: com.stitchdata.extractionJobStarted [10] at offset None
2022-02-14 11:30:18,289Z main - INFO Starting tap to discover schemas: tap-env/bin/tap-outreach --config /tmp/tap_discover_config.json --discover
2022-02-14 11:30:18,502Z main - INFO Tap exited normally.
2022-02-14 11:30:18,506Z main - INFO Saving list of discovered streams
2022-02-14 11:30:18,574Z main - INFO Saving structure of stream calls (tap_stream_id: calls)
2022-02-14 11:30:18,673Z main - INFO Saving structure of stream events (tap_stream_id: events)
2022-02-14 11:30:18,711Z main - INFO Saving structure of stream prospects (tap_stream_id: prospects)
2022-02-14 11:30:18,794Z main - INFO Saving structure of stream call_dispositions (tap_stream_id: call_dispositions)
2022-02-14 11:30:18,869Z main - INFO Saving structure of stream users (tap_stream_id: users)
2022-02-14 11:30:18,914Z main - INFO Saving structure of stream content_categories (tap_stream_id: content_categories)
2022-02-14 11:30:18,969Z main - INFO Saving structure of stream sequences (tap_stream_id: sequences)
2022-02-14 11:30:19,012Z main - INFO Saving structure of stream tasks (tap_stream_id: tasks)
2022-02-14 11:30:19,082Z main - INFO Saving structure of stream call_purposes (tap_stream_id: call_purposes)
2022-02-14 11:30:19,106Z main - INFO Saving structure of stream duties (tap_stream_id: duties)
2022-02-14 11:30:19,132Z main - INFO Saving structure of stream sequence_templates (tap_stream_id: sequence_templates)
2022-02-14 11:30:19,169Z main - INFO Saving structure of stream stages (tap_stream_id: stages)
2022-02-14 11:30:19,185Z main - INFO Saving structure of stream sequence_states (tap_stream_id: sequence_states)
2022-02-14 11:30:19,222Z main - INFO Saving structure of stream personas (tap_stream_id: personas)
2022-02-14 11:30:19,244Z main - INFO Saving structure of stream teams (tap_stream_id: teams)
2022-02-14 11:30:19,267Z main - INFO Saving structure of stream mailings (tap_stream_id: mailings)
2022-02-14 11:30:19,316Z main - INFO Saving structure of stream mailboxes (tap_stream_id: mailboxes)
2022-02-14 11:30:19,358Z main - INFO Saving structure of stream accounts (tap_stream_id: accounts)
2022-02-14 11:30:19,410Z main - INFO Saving structure of stream opportunities (tap_stream_id: opportunities)
2022-02-14 11:30:19,504Z main - INFO Saving structure of stream sequence_steps (tap_stream_id: sequence_steps)
2022-02-14 11:30:20,364Z main - INFO Writing catalog to file
2022-02-14 11:30:20,422Z main - INFO Selected fields for stream mailings: followUpTaskScheduledAt, subject, retryInterval, clickedAt, references, createdAt, mailboxAddress, sequenceStateId, clickCount, repliedAt, messageId, opportunityId, trackOpens, updatedAt, id, errorReason, sequenceId, mailboxId, retryCount, overrideSafetySettings, sequenceStepId, bodyText, bodyHtml, unsubscribedAt, notifyThreadScheduledAt, markedAsSpamAt, prospectId, trackLinks, openedAt, openCount, taskId, scheduledAt, deliveredAt, stateChangedAt, templateId, retryAt, followUpTaskType, calendarId, state, notifyThreadCondition, mailingType, bouncedAt, notifyThreadStatus, errorBacktrace
2022-02-14 11:30:20,422Z main - INFO Selected fields for stream sequence_states: callCompletedAt, positiveReplyCount, negativeReplyCount, optOutCount, prospectId, createdAt, bounceCount, accountId, activeAt, openCount, clickCount, stateChangedAt, scheduleCount, errorReason, deliverCount, updatedAt, id, failureCount, state, naturalReplyCount, pauseReason, sequenceId, creatorId, repliedAt, replyCount
2022-02-14 11:30:20,422Z main - INFO Selected fields for stream sequences: lastUsedAt, positiveReplyCount, throttleMaxAddsPerDay, optOutCount, createdAt, bounceCount, clickCount, ownerId, scheduleCount, deliverCount, description, negativeReplyCount, id, secondaryReplyPauseDuration, maxActivations, primaryReplyPauseDuration, creatorId, secondaryReplyAction, throttlePausedAt, neutralReplyCount, numContactedProspects, name, updaterId, primaryReplyAction, scheduleIntervalType, lockedAt, durationInDays, automationPercentage, replyCount, sequenceType, locked, openCount, failureCount, sequenceStepCount, shareType, throttlePaused, enabled, updatedAt, transactional, enabledAt, numRepliedProspects, tags, throttleCapacity, finishOnReply
2022-02-14 11:30:20,422Z main - INFO Selected fields for stream sequence_steps: stepType, positiveReplyCount, taskNote, negativeReplyCount, optOutCount, updaterId, createdAt, order, openCount, date, clickCount, scheduleCount, deliverCount, updatedAt, id, failureCount, bounceCount, sequenceId, interval, taskAutoskipDelay, creatorId, displayName, neutralReplyCount, replyCount
2022-02-14 11:30:20,422Z main - INFO Selected fields for stream prospects: mobilePhones, custom11, firstName, custom39, campaignName, websiteUrl1, custom47, createdAt, accountId, facebookUrl, custom12, custom20, custom35, custom24, custom10, smsOptedOut, updatedAt, updaterId, custom8, custom15, addressCountry, creatorId, timeZoneInferred, custom45, personalNote2, callOptedOut, custom2, custom26, school, workPhones, twitterUrl, custom16, name, emailsOptStatus, custom17, websiteUrl3, linkedInSlug, addressStreet, homePhones, twitterUsername, custom31, custom5, custom55, custom1, timeZone, personalNote1, defaultPluginMappingId, custom29, ownerId, custom52, optedOut, custom41, custom30, custom51, githubUrl, custom13, custom33, custom37, engagedScore, custom54, googlePlusUrl, custom25, voipPhones, stageId, tags, gender, preferredContact, custom21, custom43, emailOptedOut, occupation, linkedInUrl, clickCount, custom44, custom50, linkedInConnections, emailsOptedAt, degree, custom46, touchedAt, engagedAt, websiteUrl2, quoraUrl, specialties, custom6, custom14, title, emails, externalSource, custom32, smsOptedAt, lastName, custom22, addressCity, custom38, addressStreet2, addressState, custom42, custom19, callsOptedAt, optedOutAt, custom28, custom3, graduationDate, externalId, otherPhones, score, custom7, contactHistogram, addedAt, callsOptStatus, id, stackOverflowId, personaId, openCount, nickname, githubUsername, custom48, timeZoneIana, custom4, replyCount, middleName, dateOfBirth, custom27, custom49, addressZip, custom36, custom34, externalOwner, custom23, source, custom53, jobStartDate, linkedInId, custom40, availableAt, custom18, stackOverflowUrl, smsOptStatus, angelListUrl, custom9, eventName, region
2022-02-14 11:30:20,422Z main - INFO Selected fields for stream tasks: mailingId, completed, callId, action, completerId, prospectId, autoskipAt, taskType, createdAt, templateId, taskPriorityId, completedAt, subjectId, stateChangedAt, note, dueAt, opportunityId, updatedAt, id, state, ownerId, compiledSequenceTemplateHtml, sequenceId, creatorId, accountId, sequenceStateId, sequenceStepId, scheduledAt, taskThemeId
2022-02-14 11:30:20,422Z main - INFO Selected fields for stream calls: callPurposeId, returnedAt, prospectId, recordingUrl, answeredAt, stateChangedAt, createdAt, taskId, to, completedAt, sequenceStateId, from, note, opportunityId, outcome, updatedAt, id, state, sequenceAction, tags, sequenceId, callDispositionId, voicemailRecordingUrl, userCallType, sequenceStepId, userId, direction
2022-02-14 11:30:20,422Z main - INFO Selected fields for stream call_dispositions: createdAt, order, id, outcome, name, creatorId, updatedAt
2022-02-14 11:30:20,426Z main - INFO Current state: {"currently_syncing": null, "bookmarks": {"mailings": "2021-01-13T00:00:00Z", "sequence_states": "2022-02-13T11:30:44.000Z", "sequences": "2022-02-13T11:18:29.000Z", "sequence_steps": "2022-02-13T09:50:40.000Z", "events": "2021-03-14T21:21:37.000Z", "prospects": "2022-02-13T11:30:34.000Z", "tasks": "2022-02-13T11:15:58.000Z", "calls": "2022-02-12T18:51:31.000Z", "call_dispositions": "2021-12-14T19:12:40.000Z"}}
2022-02-14 11:30:20,427Z main - INFO Starting tap: tap-env/bin/tap-outreach --config /tmp/tap_config.json --properties /tmp/properties.json --catalog /tmp/catalog.json --state /tmp/tap_state.json
2022-02-14 11:30:20,431Z main - INFO Starting target: target-env/bin/target-stitch --config /tmp/target_config.json
2022-02-14 11:30:20,601Z tap - INFO Testing authentication
2022-02-14 11:30:20,943Z target - INFO Using batch_size_prefernces of {'batch_size_preference': None, 'user_batch_size_preference': None, 'full_table_streams': []}
2022-02-14 11:30:20,953Z tap - INFO METRIC Point(metric_type='timer', metric='http_request_duration', value=0.34778928756713867, tags={'status': 'succeeded', 'http_status_code': 200})
2022-02-14 11:30:24,211Z tap - INFO HTTP request to "stages" endpoint took 3.261s, returned status code 200
2022-02-14 11:30:24,212Z tap - INFO Skipping stream: events
2022-02-14 11:30:24,212Z tap - INFO Skipping stream: users
2022-02-14 11:30:24,212Z tap - INFO Skipping stream: content_categories
2022-02-14 11:30:24,212Z tap - INFO Skipping stream: call_purposes
2022-02-14 11:30:24,212Z tap - INFO Skipping stream: duties
2022-02-14 11:30:24,212Z tap - INFO Skipping stream: sequence_templates
2022-02-14 11:30:24,212Z tap - INFO Skipping stream: stages
2022-02-14 11:30:24,212Z tap - INFO Skipping stream: personas
2022-02-14 11:30:24,212Z tap - INFO Skipping stream: teams
2022-02-14 11:30:24,212Z tap - INFO Skipping stream: mailboxes
2022-02-14 11:30:24,212Z tap - INFO Skipping stream: accounts
2022-02-14 11:30:24,212Z tap - INFO Skipping stream: opportunities
2022-02-14 11:30:24,212Z tap - INFO call_dispositions - Syncing data since 2021-12-14T19:12:40.000Z - page: 1, limit: 250, offset: 0
2022-02-14 11:30:24,213Z main - INFO State update: adding bookmarks.call_dispositions = "2021-12-14T19:12:40.000Z"
2022-02-14 11:30:24,213Z main - INFO State update: adding bookmarks.calls = "2022-02-12T18:51:31.000Z"
2022-02-14 11:30:24,213Z main - INFO State update: adding bookmarks.events = "2021-03-14T21:21:37.000Z"
2022-02-14 11:30:24,213Z main - INFO State update: adding bookmarks.mailings = "2021-01-13T00:00:00Z"
2022-02-14 11:30:24,213Z main - INFO State update: adding bookmarks.prospects = "2022-02-13T11:30:34.000Z"
2022-02-14 11:30:24,213Z main - INFO State update: adding bookmarks.sequence_states = "2022-02-13T11:30:44.000Z"
2022-02-14 11:30:24,213Z main - INFO State update: adding bookmarks.sequence_steps = "2022-02-13T09:50:40.000Z"
2022-02-14 11:30:24,213Z main - INFO State update: adding bookmarks.sequences = "2022-02-13T11:18:29.000Z"
2022-02-14 11:30:24,213Z main - INFO State update: adding bookmarks.tasks = "2022-02-13T11:15:58.000Z"
2022-02-14 11:30:24,213Z main - INFO State update: adding currently_syncing = "call_dispositions"
2022-02-14 11:30:24,492Z tap - INFO HTTP request to "call_dispositions" endpoint took 0.279s, returned status code 503
2022-02-14 11:30:24,492Z tap - INFO Backing off request(...) for 0.6s (tap_outreach.client.Server5xxError: upstream connect error or disconnect/reset before headers. reset reason: local reset)
2022-02-14 11:30:25,362Z tap - INFO HTTP request to "call_dispositions" endpoint took 0.286s, returned status code 503
2022-02-14 11:30:25,362Z tap - INFO Backing off request(...) for 3.6s (tap_outreach.client.Server5xxError: upstream connect error or disconnect/reset before headers. reset reason: local reset)
2022-02-14 11:30:29,035Z tap - INFO HTTP request to "call_dispositions" endpoint took 0.097s, returned status code 200
2022-02-14 11:30:29,049Z target - INFO Serializing batch with 37 messages for table call_dispositions
2022-02-14 11:30:29,050Z target - INFO Sending batch of 10440 bytes to https://api.stitchdata.com/v2/import/batch
2022-02-14 11:30:29,142Z main - INFO State update: changing currently_syncing from "call_dispositions" to "calls"
2022-02-14 11:30:29,214Z main - INFO State update: changing bookmarks.calls from "2022-02-12T18:51:31.000Z" to "2022-02-13T20:05:26.000Z"
2022-02-14 11:30:29,214Z main - INFO State update: changing currently_syncing from "calls" to "mailings"
2022-02-14 11:30:29,285Z main - INFO State update: changing currently_syncing from "mailings" to "prospects"
2022-02-14 11:30:29,734Z target - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [3] at offset None
2022-02-14 11:30:29,734Z tap - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [0] at offset None
2022-02-14 11:30:29,734Z tap - INFO replicated 37 records from "call_dispositions" endpoint
2022-02-14 11:30:29,734Z tap - INFO calls - Syncing data since 2022-02-12T18:51:31.000Z - page: 1, limit: 250, offset: 0
2022-02-14 11:30:29,734Z tap - INFO HTTP request to "calls" endpoint took 0.109s, returned status code 200
2022-02-14 11:30:30,207Z tap - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [1] at offset None
2022-02-14 11:30:30,208Z tap - INFO replicated 5 records from "calls" endpoint
2022-02-14 11:30:30,208Z tap - INFO mailings - Syncing data since 2021-01-13T00:00:00Z - page: 1, limit: 250, offset: 0
2022-02-14 11:30:30,208Z tap - INFO HTTP request to "mailings" endpoint took 0.076s, returned status code 200
2022-02-14 11:30:30,214Z target - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [3] at offset None
2022-02-14 11:30:30,214Z target - INFO replicated 37 records from "call_dispositions" endpoint
2022-02-14 11:30:30,214Z target - INFO Serializing batch with 5 messages for table calls
2022-02-14 11:30:30,214Z target - INFO Sending batch of 6795 bytes to https://api.stitchdata.com/v2/import/batch
2022-02-14 11:30:30,219Z target - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [4] at offset None
2022-02-14 11:30:30,219Z target - INFO replicated 5 records from "calls" endpoint
2022-02-14 11:30:30,229Z tap - INFO replicated 0 records from "mailings" endpoint
2022-02-14 11:30:30,229Z tap - INFO prospects - Syncing data since 2022-02-13T11:30:34.000Z - page: 1, limit: 250, offset: 0
2022-02-14 11:30:30,229Z tap - INFO HTTP request to "prospects" endpoint took 0.295s, returned status code 503
2022-02-14 11:30:30,229Z tap - INFO Backing off request(...) for 1.8s (tap_outreach.client.Server5xxError: upstream connect error or disconnect/reset before headers. reset reason: local reset)
2022-02-14 11:30:33,142Z tap - INFO HTTP request to "prospects" endpoint took 1.790s, returned status code 200
2022-02-14 11:30:34,039Z tap - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [8] at offset None
2022-02-14 11:30:34,040Z tap - INFO replicated 250 records from "prospects" endpoint
2022-02-14 11:30:34,040Z tap - INFO prospects - Syncing data since 2022-02-13T11:30:34.000Z - page: 2, limit: 250, offset: 250
2022-02-14 11:30:34,990Z tap - INFO HTTP request to "prospects" endpoint took 1.438s, returned status code 200
2022-02-14 11:30:35,387Z tap - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [3] at offset None
2022-02-14 11:30:35,387Z tap - INFO replicated 250 records from "prospects" endpoint
2022-02-14 11:30:35,387Z tap - INFO prospects - Syncing data since 2022-02-13T11:30:34.000Z - page: 3, limit: 250, offset: 500
2022-02-14 11:30:36,944Z tap - INFO HTTP request to "prospects" endpoint took 1.562s, returned status code 200
2022-02-14 11:30:37,334Z tap - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [2] at offset None
2022-02-14 11:30:37,334Z tap - INFO replicated 250 records from "prospects" endpoint
2022-02-14 11:30:37,334Z tap - INFO prospects - Syncing data since 2022-02-13T11:30:34.000Z - page: 4, limit: 250, offset: 750
2022-02-14 11:30:37,601Z tap - INFO HTTP request to "prospects" endpoint took 0.271s, returned status code 503
2022-02-14 11:30:37,601Z tap - INFO Backing off request(...) for 2.8s (tap_outreach.client.Server5xxError: upstream connect error or disconnect/reset before headers. reset reason: local reset)
2022-02-14 11:30:40,669Z tap - INFO HTTP request to "prospects" endpoint took 0.280s, returned status code 503
2022-02-14 11:30:40,669Z tap - INFO Backing off request(...) for 1.1s (tap_outreach.client.Server5xxError: upstream connect error or disconnect/reset before headers. reset reason: local reset)
2022-02-14 11:30:42,086Z tap - INFO HTTP request to "prospects" endpoint took 0.287s, returned status code 503
2022-02-14 11:30:42,086Z tap - INFO Backing off request(...) for 5.6s (tap_outreach.client.Server5xxError: upstream connect error or disconnect/reset before headers. reset reason: local reset)
2022-02-14 11:30:49,344Z tap - INFO HTTP request to "prospects" endpoint took 1.699s, returned status code 200
2022-02-14 11:30:49,704Z tap - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [5] at offset None
2022-02-14 11:30:49,704Z tap - INFO replicated 250 records from "prospects" endpoint
2022-02-14 11:30:49,704Z tap - INFO prospects - Syncing data since 2022-02-13T11:30:34.000Z - page: 5, limit: 250, offset: 1000
2022-02-14 11:30:49,975Z tap - INFO HTTP request to "prospects" endpoint took 0.275s, returned status code 503
2022-02-14 11:30:49,975Z tap - INFO Backing off request(...) for 0.5s (tap_outreach.client.Server5xxError: upstream connect error or disconnect/reset before headers. reset reason: local reset)
2022-02-14 11:30:52,548Z tap - INFO HTTP request to "prospects" endpoint took 2.064s, returned status code 200
2022-02-14 11:30:52,725Z target - INFO Serializing batch with 1109 messages for table prospects
2022-02-14 11:30:52,855Z target - INFO Sending batch of 2017981 bytes to https://api.stitchdata.com/v2/import/batch
2022-02-14 11:30:52,855Z target - INFO Sending batch of 2021392 bytes to https://api.stitchdata.com/v2/import/batch
2022-02-14 11:30:52,865Z target - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [5] at offset None
2022-02-14 11:30:52,866Z target - INFO replicated 1109 records from "prospects" endpoint
2022-02-14 11:30:53,061Z tap - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [7] at offset None
2022-02-14 11:30:53,061Z tap - INFO replicated 250 records from "prospects" endpoint
2022-02-14 11:30:53,061Z tap - INFO prospects - Syncing data since 2022-02-13T11:30:34.000Z - page: 6, limit: 250, offset: 1250
2022-02-14 11:30:53,994Z main - INFO State update: changing bookmarks.prospects from "2022-02-13T11:30:34.000Z" to "2022-02-14T05:22:37.000Z"
2022-02-14 11:30:54,925Z tap - INFO HTTP request to "prospects" endpoint took 1.869s, returned status code 200
2022-02-14 11:30:55,309Z tap - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [0] at offset None
2022-02-14 11:30:55,309Z tap - INFO replicated 250 records from "prospects" endpoint
2022-02-14 11:30:55,309Z tap - INFO prospects - Syncing data since 2022-02-13T11:30:34.000Z - page: 7, limit: 250, offset: 1500
2022-02-14 11:30:57,246Z tap - INFO HTTP request to "prospects" endpoint took 1.941s, returned status code 200
2022-02-14 11:30:57,641Z tap - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [5] at offset None
2022-02-14 11:30:57,641Z tap - INFO replicated 250 records from "prospects" endpoint
2022-02-14 11:30:57,641Z tap - INFO prospects - Syncing data since 2022-02-13T11:30:34.000Z - page: 8, limit: 250, offset: 1750
2022-02-14 11:30:59,490Z tap - INFO HTTP request to "prospects" endpoint took 1.854s, returned status code 200
2022-02-14 11:30:59,865Z tap - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [3] at offset None
2022-02-14 11:30:59,865Z tap - INFO replicated 250 records from "prospects" endpoint
2022-02-14 11:30:59,865Z tap - INFO prospects - Syncing data since 2022-02-13T11:30:34.000Z - page: 9, limit: 250, offset: 2000
2022-02-14 11:31:00,258Z tap - INFO HTTP request to "prospects" endpoint took 0.398s, returned status code 200
2022-02-14 11:31:00,344Z target - INFO Serializing batch with 931 messages for table prospects
2022-02-14 11:31:00,348Z tap - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [1] at offset None
2022-02-14 11:31:00,348Z tap - INFO replicated 40 records from "prospects" endpoint
2022-02-14 11:31:00,349Z tap - INFO sequence_states - Syncing data since 2022-02-13T11:30:44.000Z - page: 1, limit: 250, offset: 0
2022-02-14 11:31:00,398Z target - INFO Sending batch of 3388974 bytes to https://api.stitchdata.com/v2/import/batch
2022-02-14 11:31:00,406Z target - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [0] at offset None
2022-02-14 11:31:00,406Z target - INFO replicated 931 records from "prospects" endpoint
2022-02-14 11:31:00,753Z tap - INFO HTTP request to "sequence_states" endpoint took 0.408s, returned status code 200
2022-02-14 11:31:00,913Z tap - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [1] at offset None
2022-02-14 11:31:00,913Z tap - INFO replicated 250 records from "sequence_states" endpoint
2022-02-14 11:31:00,913Z tap - INFO sequence_states - Syncing data since 2022-02-13T11:30:44.000Z - page: 2, limit: 250, offset: 250
2022-02-14 11:31:01,185Z tap - INFO HTTP request to "sequence_states" endpoint took 0.277s, returned status code 503
2022-02-14 11:31:01,185Z tap - INFO Backing off request(...) for 0.3s (tap_outreach.client.Server5xxError: upstream connect error or disconnect/reset before headers. reset reason: local reset)
2022-02-14 11:31:01,842Z tap - INFO HTTP request to "sequence_states" endpoint took 0.388s, returned status code 200
2022-02-14 11:31:01,990Z tap - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [1] at offset None
2022-02-14 11:31:01,990Z tap - INFO replicated 250 records from "sequence_states" endpoint
2022-02-14 11:31:01,990Z tap - INFO sequence_states - Syncing data since 2022-02-13T11:30:44.000Z - page: 3, limit: 250, offset: 500
2022-02-14 11:31:02,086Z tap - INFO HTTP request to "sequence_states" endpoint took 0.100s, returned status code 200
2022-02-14 11:31:02,094Z target - INFO Serializing batch with 510 messages for table sequence_states
2022-02-14 11:31:02,099Z tap - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [2] at offset None
2022-02-14 11:31:02,099Z tap - INFO replicated 10 records from "sequence_states" endpoint
2022-02-14 11:31:02,099Z tap - INFO sequence_steps - Syncing data since 2022-02-13T09:50:40.000Z - page: 1, limit: 250, offset: 0
2022-02-14 11:31:02,100Z target - INFO Sending batch of 310578 bytes to https://api.stitchdata.com/v2/import/batch
2022-02-14 11:31:02,107Z target - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [1] at offset None
2022-02-14 11:31:02,108Z target - INFO replicated 510 records from "sequence_states" endpoint
2022-02-14 11:31:02,214Z tap - INFO HTTP request to "sequence_steps" endpoint took 0.119s, returned status code 200
2022-02-14 11:31:02,231Z target - INFO Serializing batch with 21 messages for table sequence_steps
2022-02-14 11:31:02,231Z target - INFO Sending batch of 15348 bytes to https://api.stitchdata.com/v2/import/batch
2022-02-14 11:31:02,235Z tap - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [9] at offset None
2022-02-14 11:31:02,239Z target - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [0] at offset None
2022-02-14 11:31:02,239Z target - INFO replicated 21 records from "sequence_steps" endpoint
2022-02-14 11:31:02,245Z tap - INFO replicated 21 records from "sequence_steps" endpoint
2022-02-14 11:31:02,246Z tap - INFO sequences - Syncing data since 2022-02-13T11:18:29.000Z - page: 1, limit: 250, offset: 0
2022-02-14 11:31:02,347Z main - INFO State update: changing bookmarks.prospects from "2022-02-14T05:22:37.000Z" to "2022-02-14T11:30:57.000Z"
2022-02-14 11:31:02,347Z main - INFO State update: changing currently_syncing from "prospects" to "sequence_states"
2022-02-14 11:31:02,432Z tap - INFO HTTP request to "sequences" endpoint took 0.200s, returned status code 200
2022-02-14 11:31:02,444Z target - INFO Serializing batch with 15 messages for table sequences
2022-02-14 11:31:02,444Z target - INFO Sending batch of 22639 bytes to https://api.stitchdata.com/v2/import/batch
2022-02-14 11:31:02,449Z tap - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [7] at offset None
2022-02-14 11:31:02,452Z target - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [1] at offset None
2022-02-14 11:31:02,452Z target - INFO replicated 15 records from "sequences" endpoint
2022-02-14 11:31:02,459Z tap - INFO replicated 15 records from "sequences" endpoint
2022-02-14 11:31:02,459Z tap - INFO tasks - Syncing data since 2022-02-13T11:15:58.000Z - page: 1, limit: 250, offset: 0
2022-02-14 11:31:02,470Z main - INFO State update: changing bookmarks.sequence_states from "2022-02-13T11:30:44.000Z" to "2022-02-14T11:30:57.000Z"
2022-02-14 11:31:02,470Z main - INFO State update: changing currently_syncing from "sequence_states" to "sequence_steps"
2022-02-14 11:31:02,712Z main - INFO State update: changing bookmarks.sequence_steps from "2022-02-13T09:50:40.000Z" to "2022-02-14T11:27:28.000Z"
2022-02-14 11:31:02,712Z main - INFO State update: changing currently_syncing from "sequence_steps" to "sequences"
2022-02-14 11:31:02,725Z tap - INFO HTTP request to "tasks" endpoint took 0.280s, returned status code 503
2022-02-14 11:31:02,725Z tap - INFO Backing off request(...) for 0.7s (tap_outreach.client.Server5xxError: upstream connect error or disconnect/reset before headers. reset reason: local reset)
2022-02-14 11:31:02,863Z main - INFO State update: changing bookmarks.sequences from "2022-02-13T11:18:29.000Z" to "2022-02-14T11:27:28.000Z"
2022-02-14 11:31:02,863Z main - INFO State update: changing currently_syncing from "sequences" to "tasks"
2022-02-14 11:31:03,900Z tap - INFO HTTP request to "tasks" endpoint took 0.463s, returned status code 200
2022-02-14 11:31:03,940Z tap - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [0] at offset None
2022-02-14 11:31:03,940Z tap - INFO replicated 57 records from "tasks" endpoint
2022-02-14 11:31:03,959Z target - INFO Serializing batch with 57 messages for table tasks
2022-02-14 11:31:03,960Z target - INFO Sending batch of 51947 bytes to https://api.stitchdata.com/v2/import/batch
2022-02-14 11:31:03,967Z target - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [2] at offset None
2022-02-14 11:31:03,967Z target - INFO replicated 57 records from "tasks" endpoint
2022-02-14 11:31:04,062Z main - INFO State update: changing bookmarks.tasks from "2022-02-13T11:15:58.000Z" to "2022-02-14T11:16:00.000Z"
2022-02-14 11:31:04,063Z target - INFO Requests complete, stopping loop
2022-02-14 11:31:04,063Z main - INFO State update: changing currently_syncing from "tasks" to null
2022-02-14 11:31:04,132Z main - INFO Target exited normally with status 0
2022-02-14 11:31:05,186Z main - INFO [smart-services] event successfully sent to kafka: com.stitchdata.extractionJobFinished [16] at offset None
2022-02-14 11:31:05,189Z main - INFO No tunnel subprocess to tear down
2022-02-14 11:31:05,189Z main - INFO Exit status is: Discovery succeeded. Tap succeeded. Target succeeded.

@sgandhi1311
Copy link
Member

Hello @eestack, Can you please confirm whether the issue persists?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants