In this article

    When an IT or security team gets asked to approve an AI chatbot for portfolio data, the demo rarely raises the right questions. A chatbot that summarizes a rent roll or answers a CapEx question well in a sales call still has to survive a security review before it touches lease files, general ledger data, or fund-level financials. The review that matters is narrower than most vendor pitches suggest: where the data is processed, how access gets enforced before a query runs, what the model provider can see, what gets logged, and how the system contains a failure. This article breaks that review into six areas — deployment, data, access, models, audit, and incident response — and ends with a 20-question checklist an IT or security team can run against any vendor pitching an internal CRE AI chatbot.

    Key takeaways

    • A secure CRE AI chatbot restricts what data can be retrieved before an answer is generated. Filtering the response after the fact is not a reliable access control.
    • Prompt injection is the top-ranked risk in OWASP's 2025 Top 10 for LLM Applications, and it can arrive through an uploaded lease or rent roll, not only through a typed message.
    • Fund and joint-venture structures need access boundaries that stop an aggregate portfolio answer from revealing another entity's confidential numbers, not just document-level permissions.
    • Audit logs are only useful in a security review if they tie the question, the retrieved source, the model version, and the user identity together in one record.
    • Model routing — sending different query types to different underlying models — changes what data a third-party provider sees, so it belongs in the same review as encryption and access.
    • A 20-question review grouped by deployment, access, data, models, audit, and incident response gives IT and security teams a repeatable way to compare vendors instead of relying on a sales deck.

    What "secure" actually means for a CRE AI chatbot

    A secure AI chatbot for commercial real estate is an internal assistant that answers questions about portfolio data while enforcing the same access, audit, and data-boundary controls a security team would already require of any system holding lease, financial, or tenant information. That's a different bar than a public-facing leasing chatbot that answers listing questions for prospects, which typically works with availability and marketing data rather than rent rolls or GL detail.

    The thesis worth holding onto through the rest of this review: model quality is not the security question. A model can answer occupancy questions accurately and still be an unacceptable risk if it runs in an environment the vendor doesn't fully disclose, if it can't tell a user's real permissions from a broadly scoped service account, or if it treats an uploaded rent roll as a source of instructions instead of just data. The sections below work through where those risks actually sit.

    Deployment models: where the AI actually processes CRE data

    Vendors describe deployment in marketing language that hides real architectural differences. Three models cover most of what's on the market, and they carry different risk profiles.

    Deployment modelWhere data livesWho can access infrastructureTypical audit ownership
    Shared multi-tenant SaaSVendor-controlled environment, shared across customersVendor engineering and operations staffVendor owns most logs; customer visibility varies
    Single-tenant / dedicated instanceVendor-controlled environment, isolated per customerVendor staff, scoped to that instanceVendor owns infrastructure logs; customer may get application logs
    Customer-hosted / deployed in customer's cloud tenantCustomer's own cloud environmentCustomer's own IT and security teams, plus the vendor under contracted accessCustomer owns infrastructure logs directly

    None of these three is automatically "secure" or "insecure." A well-run multi-tenant SaaS product can be safer than a poorly maintained customer-hosted deployment. What matters is whether the vendor can answer, specifically, which model applies and what that means for encryption key ownership, infrastructure access, and log ownership. Bayaan, for example, runs inside the customer's own Microsoft Azure environment rather than a shared Bayaan-controlled tenant, which is the kind of specific, verifiable claim a security reviewer should expect from any vendor in this category.

    Encryption in transit and at rest is table stakes at this point, but "we encrypt your data" is not a complete answer. Ask who holds the keys, whether encryption applies to cached query results and temporary files, and what happens to that cached data once a session ends.

    Data boundaries and training policy

    The question every CRE security reviewer asks first — does our data train your model — is necessary but not sufficient. A vendor can answer "no" honestly and still have gaps elsewhere: where the data physically resides, how long it's retained after a document is deleted from the source system, and whether a routing decision (see the models section below) sends part of a query to a third-party model provider that has a different training policy than the primary vendor.

    [[VERIFY: Bayaan's current data retention period for uploaded documents and chat history, if a specific figure is publicly stated]]

    Training policy also interacts with document handling. A lease abstraction workflow or an uploaded rent roll may pass through the system before it's connected as a live data source. That intermediate step needs the same training-policy answer as the live connection itself — a vendor that's careful about the database connection but vague about temporary file handling during onboarding has a real gap, not a technicality.

    Authentication, SSO, and enforcing access before retrieval

    Single sign-on integration is the easy part of this section; most enterprise AI vendors support SAML or OIDC with a mainstream identity provider. The harder question is where permission checks actually happen in the request path.

    A system that generates a full answer and then redacts restricted fields before displaying it has already retrieved data the user wasn't supposed to see. That data sat in memory, potentially in logs, and potentially in a cached result — even if the final screen looks clean. A system built for CRE portfolio data should check the user's role, scope, and entity access before the query runs against leases, rent roll, or GL data, not after the model has already generated a response from unrestricted retrieval.

    This matters more in CRE than in most industries because access isn't just role-based in the generic sense — it's entity-based. An asset manager might have full access to one region's properties and none to another's. A finance user might see NOI at the property level but not individual tenant-level rent concessions. Role-based access control design for CRE AI is deep enough to own its own review; the point here is narrower: confirm that access enforcement happens before retrieval, and treat any other answer as a real finding, not a nuance.

    Fund, joint-venture, and portfolio segregation

    Document-level permissions are the easiest form of access control to implement and the easiest to get wrong for CRE portfolios that include funds, joint ventures, and co-owned assets. Restricting which lease files or rent rolls a user can open doesn't automatically restrict what that user can learn by asking an aggregate question.

    Consider a worked example. A regional asset manager has legitimate access to Fund A's properties and no access to Fund B's. Fund A and Fund B share a JV interest in one property, and both funds' data lives in the same underlying warehouse the chatbot queries. The asset manager asks: "What's average same-store NOI growth across all properties I can see?" If the system's access model is enforced only at the document level, the aggregate calculation can pull in Fund B's numbers behind the scenes, and the answer — a single average — can shift enough to let a careful user infer something about Fund B's performance, even without ever seeing a Fund B document directly.

    A security review for CRE AI needs to ask specifically how aggregate queries are scoped, not just how individual records are protected. That's a different, harder engineering problem than row-level security in a traditional database, because the model is generating a summary rather than returning rows a permission filter can simply drop.

    Model routing, prompt injection, and document-borne instructions

    Multi-model routing — sending different types of queries to different underlying models, sometimes from different providers — is common in enterprise AI products, and it changes the security surface in ways worth naming directly. Every provider a query gets routed to is a party that can, in principle, see that query and whatever data it contains. A security review should ask which providers are in the routing path, under what conditions, and whether that routing can be restricted or disabled for the most sensitive data domains.

    Prompt injection deserves its own line of questioning. It's ranked the top risk in OWASP's 2025 Top 10 for LLM Applications, and the report describes both direct injection, where a user types malicious instructions, and indirect injection, where the model reads untrusted content from documents, emails, or other retrieved sources and follows instructions embedded in that content rather than treating it as data. For a CRE chatbot, the realistic version of indirect injection isn't a hacker typing commands. It's a lease PDF, a rent roll export, or an uploaded due-diligence document that contains hidden or embedded text designed to change how the model behaves for the next user who queries it.

    OWASP's own guidance is candid that no method fully prevents prompt injection; the mitigations are about reducing exposure — separating untrusted content from instructions, filtering input and output, and testing adversarially — rather than eliminating the risk outright. A vendor that claims prompt injection is "solved" should be treated as a red flag rather than reassurance.

    Audit trails and incident response

    An audit log that records "user asked a question at 2:14 p.m." is close to useless for a security review. A log worth relying on ties together the question text, the specific data retrieved to answer it, the model version that generated the response, and the identity of the user who asked — as one linked record, not four separate systems a security team has to reconcile after the fact.

    Incident response is the part of this review most often skipped because it only matters when something has already gone wrong. Ask what the vendor's process is for revoking access or rotating credentials after a suspected compromise, who notifies the customer and within what timeframe if the vendor identifies an incident touching customer data, and whether the customer's own security team can pull logs independently during an investigation rather than depending entirely on the vendor to produce them.

    The 20-Question CRE AI Security Review

    This framework groups the questions above — plus a few that only come up once you're comparing vendors side by side — into six categories. Send it to a vendor before the first technical demo, not after.

    Deployment

    1. Does the chatbot run in a shared multi-tenant environment, a dedicated single-tenant instance, or inside our own cloud environment?
    2. Who can access the underlying infrastructure, and under what conditions?
    3. Is data encrypted in transit and at rest, and who holds the encryption keys?
    4. What happens to cached or temporary query data once a session ends?

    Access

    1. Does the system support our existing SSO and identity provider?
    2. Is access enforced before a query retrieves data, or only filtered from the response afterward?
    3. How quickly are role changes and offboarding reflected in chatbot access?
    4. Can a service account or backend integration bypass user-level permissions?

    Data

    1. Is our data used to train the vendor's model or any third-party model it routes to?
    2. Where does our data reside, and does that location change based on a routing decision?
    3. How does the system prevent an aggregate answer from revealing a restricted fund, JV, or property's underlying numbers?
    4. What is the retention and deletion policy for uploaded documents and chat history?

    Models

    1. Which model providers does the system route queries to, and can that routing be restricted for sensitive data domains?
    2. How does the system handle instructions embedded inside an uploaded document, such as a lease PDF or rent roll?
    3. What input and output filtering runs before a response reaches the user?
    4. Has the vendor run adversarial or prompt-injection testing against the actual deployed configuration, not just the base model?

    Audit

    1. Does every query and response get logged with user identity, timestamp, retrieved source, and model version together?
    2. Can our security team export or independently review those logs, or only the vendor?

    Incident response

    1. What is the vendor's process for revoking access or rotating credentials after a suspected compromise?
    2. Who notifies us, and within what timeframe, if the vendor identifies an incident involving our data?

    Where this falls short

    This review checks architecture, not execution. A vendor can answer all 20 questions well and still misconfigure a permission rule during a live deployment; no external review catches an operational mistake made after go-live, which is why the review has to repeat periodically rather than serve as a one-time gate.

    Audit logs establish what was asked and what was returned, not whether the source-system figure behind the answer was correct in the first place. A citation traces a number back to a field in a database or document. It doesn't verify that whoever entered that field got it right.

    Prompt injection mitigations reduce exposure; they don't close it. OWASP is explicit that there's no fully reliable prevention method given how current models process instructions and data through the same channel, so a vendor's testing and filtering practices matter more than any claim of having solved the problem.

    Fund and JV segregation depends on how cleanly the underlying data model represents entity boundaries. A portfolio with a messy or manually maintained ownership structure can undermine even a well-designed access model, because the system can only enforce boundaries it can actually see in the data.

    Turn portfolio questions into governed answers

    See how Bayaan helps CRE teams connect governed business data, investigate portfolio questions, and generate trusted outputs.

    Talk to Bayaan

    How to run this review with a vendor

    • Send the 20 questions before the first technical demo, and ask for written answers to the data and models sections specifically — a verbal answer in a sales call isn't something a security team can file.
    • Request the deployment-model detail in writing: which of the three models applies, and what that means for key ownership and log access.
    • Ask for a real incident-response document, not a verbal assurance that "we'd handle it."
    • Test document-borne instruction handling in a sandbox with a sample lease or rent roll before granting access to live portfolio data.
    • Loop in IT and security from the first pilot, not after the business sponsor has already committed to the vendor.
    • Revisit the review annually or after any material change to the vendor's model routing or infrastructure, since this checks a point-in-time architecture rather than an ongoing guarantee.